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ABSTRACT 



This paper deals with a method of optimizing the free coeffi- 
cients in the characteristic equation of a linear feedback control 
system. The optimization is carried out by minimizing an index 
of performance associated with the system's response to a given 
test disturbance. 

The index of performance is the integral of a quadratic func- 
tion of the system state variables. The structure of the index 
rests upon a logical interpretation of the regulator nature of the 
control problem. The index for an order system contains n 
weighting factors whose values are determined from an order 
model system. This determination is such that the optimization 
of a completely free system will yield the model system. A sys- 
tem with fewer than n degrees of freedom in the state variable 
feedbacks may be optimized with respect to the free feedback co- 
efficients, yielding a system whose dynamic response to a given 
disturbance is, for this optimization scheme, a best approximation 
to that of the model. 

Examples are presented for illustration of the salient features 
of the method. It is also shown by example that systems with 
closed-loop zeros may be optimized by this method. 

The author wishes to thank Dr. Harold A. Titus for his guid- 
ance in this investigation. 
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CHAPTER I 



INTRODUCTION 

The task of designing a feedback control system normally begins 
with a mathematical modeling of the open-loop system, process, or plant 
that is to be controlled. This modeling permits an analytical treat- 
ment whereby the response of the closed-loop system is determined for a 
given test input. This response is very likely, at first, to be unsatis- 
factory with respect to a given set of specifications; compensation of 
the control system is then indicated. 

Compensation is to some extent a matter of judgement; i.e., the 
choice of a compensation scheme depends upon such factors as cost, 
physical limitations of equipment, availability of certain items of 
information as readable signals, etc., all tempered by the experience 
of the designer. 

It is now assumed that a compensation scheme has been chosen by 
the designer, and that the resulting compensated closed- loop transfer 
function has no zeros* and may be written 

^ —2 

s ^as «^a -S -^•..».|.a. 
n n-1 1 

where the a's and k are functions of the various plant and compensator 
parameters. The signal-flow graph of Figure 1 represents the transfer 
function of equation (1). 

* This restriction will later be relaxed. 
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r k u s s ^2 s ^ 




Fig. 1 Signal-flow graph for the 
transfer function of equation (1) 

It is at this point that the designer must translate the given 
time and/or frequency domain specifications into desired root values 
for the characteristic polynomial, or equivalently, the poles of the 
closed-loop transfer function. If all n coefficients in the character- 
istic equation were freely variable, the n poles could conceivably be 
placed at any pre-selected combination of positions. This, of course, 

is rarely the case, since some of the a 's contain or represent fixed 

n 

plant parameters. As a rule, one free parameter is required for each 
distinct pole that is to be placed in a pre-selected position, or 
conversely, as many poles may be arbitrarily placed as there are free 
coefficients in the characteristic equation. Magnitude constraints 
and other physical limitations may further restrict the placement of 
poles to certain regions in the s-plane, 

** A complex conjugate pair may have one or the other of its polar co- 
ordinates (zeta, omega) fixed by one free coefficient. 
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On the ability to pre-select some of the poles of the system rests 
the basis of the dominant mode method of design« The designer uses as 
many free coefficients as are available to place a corresponding number 
of the n poles in pre-selected positions, with the hope that these poles 
so placed will dominate the response of the system to any input o Whether 
or not they are indeed dominant depends upon where the remaining poles 
are found to lie, how they make their presence felt in the time or fre- 
quency domain, and upon the degree of extra-pole interference judged 
to be tolerable by the designer o It is to be noted that the presence 
of closed- loop zeros further complicates the dominance picture, very 
possibly destroying the hoped-for dominance of a carefully placed set 
of poles o 

The dominant mode method places emphasis on a limited number of 
the system's closed-loop poles in the hope that they will dominate the 
system dynamics. It is shown herein that more attention might pro- 
fitably be directed toward placing all the system^ s poles in such a 
way that no group of poles is necessarily dominant, while all the 
poles collectively give system dynamics closely emulating those of the 
specifications. Such a procedure would start by establishing an ideal 
or model system of the form of Figure 1. This model system would be 
of the same order as the actual system, and the a^ coefficients would 
be selected on the basis of the given specifications and their trans- 
lation to suitable pole values. A similar diagram, drawn for the 
actual system, would show some of the feedback coefficients as functions 
of fixed system parameters, the remainder as variable functions of the 
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free plant or compensator parameters. The presence of fixed parameters 
in the actual system effectively constrains the eventual design to cer- 
tain definite regions in the s-plane- The design proceeds by selecting 
values of the variable coefficients in the constrained, actual system 
in such a way that it closely approximates the ideal model in its dy- 
namic behavior in response to a given disturbance. This selection is 
to be made through the mechanism of a cost function, or index of per- 
formance, the fundamental structure of which is based upon intuitive 
judgement and some mathematical requirements. The index is so fash- 
ioned that it contains n undetermined weighting factors, where n is 
the order of the system being considered. To derive an algorithm for 
the determination of these factors for all systems of order n, an 
optimization, or minimization of the index is first carried out in 
such a way that the n weighting factors are forced to be functions 

of the n model feedback coefficients, the a 's. 

n 

The actual n order system is once again considered. The index 
becomes, at this point, a function of some fixed system parameters, 
some variable parameters whose values are to be optimized, the n 
weighting factors whose values are determined by the designer's choice 
of a model system, and the n state variables as they respond to a 
given disturbance. If n parameters in the actual system were free, 
minimization of the index would drive those parameters to the model 
values, giving the desirable result of identical model and actual sys- 
tems. If ml (m < n) of the actual coefficients were fixed, minimization 
of the index with respect to the remaining n-m free coefficients would 
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yield a system optimum with respect to an index of performance not en- 
tirely arbitrary, but based in good measure upon the pole locations of 
an ideal model system. In this sense, then, the system so designed is 
a “best** approximation to the model. 

In the literature dealing with the optimum design of linear feed- 
back control systems, much reference is made to arbitarily selected in- 
dices of performance, many of which will either not allow the selection 
of finite values for certain parameters, or will not allow optimization 
with respect to more than one system parameter; eog., integral square 
error. Furthermore, optimization with respect to such indices often 
seems too much like an end in itself, rather than a means to the end 
of procuring system dynamics that will meet given time and frequency 
domain specifications. 

Some attempts have been made to overcome the deficiencies mentioned 
above. Rekasius^ has proposed an index based on a model differential 
equation of order less than that of the actual system being designed. 
This approach somewhat restricts the flexibility available to the de- 
signer in constructing a satisfactory model. The present method also 
allows optimization with respect to an index of performance; a single 
measure, to be sure, but one which incorporates such time and frequency 
domain specifications as bandwidth, rise time, and peak overshoot 
through the correlation of model dynamic response to model pole location 
and the dependence of the index’s weighting factors on these pole lo- 
cations. Furthermore, the model and actual systems are necessarily of 
the same order. 
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The chapters that follow will show the main steps in the selection 
of the model-based index of performance and the derivation of the algo- 
rithm by which the n weighting factors are determined. The algebraic 

details of the derivation are given in the appendix. The index is 

th 

generalized for the n order system with no zeros in the closed- loop 
transfer function. Included are several examples of the use of the 
index in system design, for demonstration of the salient features of 
the method. It is also shown by example that the index may be used 
in the design of systems including zeros. 
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CHAPTER II 



DERIVATION OF THE INDEX OF PERFORMANCE 

1 

The index of performance, or cost function , that is to link the 
actual and model system behavior will by choice be a quadratic integral 
functional of the form 



J = r (x^QiX + (2) 

o 

where x and u are as shown in Figure 1. A quadratic form is chosen 
simply because it admits of some mathematical treatment that would be 
very difficult if not impossible had another form been chosen. The 
differential equation of the system of Figure 1 may be written in 
vector matrix form as 



X s Gx 4 - u 



(3) 



where G is given by 



G = 



0 1 



o 

0 1 

\ \ 

\ \ 

\ ^1 



O 



\ 



0 



(4) 



from' 



X = X , ; m < n 

m m^.1 



(5a) 



and 



'X = u 
n 



(5b) 



For convenience, systeip response will be initiated by initial conditions 
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rather than by external Inputs, resulting in a u matrix of the form 

X (6) 

Equation (3) may now be written 
X = Gx + Ax 

= Fx (7) 

The transpose of equation (6) may be substituted into equation 
(2) to give 

J = J [x’^(Qi + a''^Q2A) x] dt 

» T 

x^9x dt (8) 

o 

Except for the form of the Qj^ and matrices, equations (2) through 
(8) completely describe the model system and its associated cost function. 

The evaluation of J for an arbitrary set of initial conditions is 
to be carried out using vector matrix methods. Consider a Liapunov func« 
tion of the system; 

V(x) = x^I^ (5) 

Where P is a positive-definite, symmetric matrix. V(x) possesses the 

2 

following properties , provided the system is stable: 
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a) V(x) >0, X / 0 

=0, X = 0 

b) v(x) = < 0, X > 0 

= 0, X = 0 



( 10 ) 



c) V(x) -» 00 as I x| -♦ oo 

d) V(x) -* 0 as t -♦ 00 



Differentiation of equation (9) with respect to time yields 

V(x) = x^PX + x'^IX (11) 

Using the transpose of equation (7) in equation (11) gives 

V(x) = x^(F^P + PF) X (12) 

To this point, the P matrix and the V(x) function associated with it 
are not defined. This definition is established by 

V(x) = x^(F^P 4 . PF) X 

= i'^(-Q) X (13) 

Equation (13) is now integrated as follows: 

® rt® rr 

r V(x)dt = - 1 i Qx dt (14) 

o o 

The right-hand side of the preceeding equation is immediately recog- 
nized as the negative of the cost function, equation (8)o Evaluating 
the left-hand side of (14) and substituting limits yieldsc 

J = - v[x(oo)] + v[x(0)] (15) 

For a stable system, x(») -• 0, and from the properties given in equations 
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(10), V [0] = 0. 



Therefore 



J = V [x(0)] = x(0) (16) 

Equation (16) reveals that the cost Incurred by the system in response 
to a set of initial conditions is a function only of those Initial 
conditions and of the P matrix. The P matrix in turn is a function of 
the system's F matrix and of the Q matrix, as given in equation (13). 
There remains, then, the task of fashioning the Q matrix to fulfill 
the mission set forth in the introduction and above. The following 
requirements, some mathematical and others intuitively logical, are 
to be considered in the selection of the and matrices; 

a) Q must be a square, nxn, symmetric matrix. 

b) Q is to be such that all states are Included in J. This is a 
logical consequence of the regulator nature of the problem. 
Since all states are to be driven to zero, they should all 
contribute in some measure to the cost, the subsequent mini- 
mization of which yields an optimum transition to the origin 
of the state space. 

c) and are to be such that together they introduce n 
weighting factors, whose values will ultimately depend upon 
the n feedback coefficients of the model system, or, equi- 
valently, upon the model poles. 

d) Q is to be such that J Includes the "control effort" vari- 
able u. This will act as a constraint to prevent results 
calling for infinite system parameters. It also insures that 
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the optimum control is a linear function of the system 
states^. 

In the light of the requirements stated above, the following con- 
figurations are suggested for the and matrices; 




where eX2 through and X constitute the n weighting factors. These 
combine by equation (8) to give 



Q = 



1 + Xa 






>Vi 






<»2 + Xaj 






X 

X 



a a 
1 n 



^2^n 




. 2 
n n 



(18) 



The P matrix may now be evaluated literally, from equation (13). This 
is done for the second and third- order systems in the appendix, with 
results included for the fourth and fifth-order models as well. The 
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second-order results are presented here for Illustration. 



Pll- -^12 + 2:^7 ‘111 + 2^ <V ‘*22 + -^^7 J 

_ _ _ ^ 

Pl2 “ P 2 I “ 2a^ 

I r ‘*11 ^ 

P 22 * 2a2 V^22 ■*■ sl^ ) 

With the appropriate substituted in equations (19), 



^2 ^ 1°^2 1 ^^1 
Oq 0-. + •>« + 0» 



'll 


2^ 


232 




^232 


12 “ 


^21 


1 


X3j_ 

+ "-y- 






“2 


X32 


1 


X3i 


22 “ 


2^2 


+ + 


2^^2 ^ 


2^2 



( 19 ) 



( 20 ) 



Equation (16) is now written in scalar form to show the relationship 
between J, the initial conditions, and the elements of the P matrix. 

J = x^(0) p^^ + 2pj2 Xj(0) X2(0) + x^(0) p ^2 (21) 



What follows is the key point of the entire derivation. The values 
of and X roust be found so that, for the unconstrained system, the 
minimization of J with respect to a^ and a 2 gives resulting optimum 
values of ai and that are, independently of the initial conditions, 
equal to the model values ; i.e., it is necessary to find the elements 
0^2 and X as functions of the desired coefficients a^ and a^ so that 
the adjustment of the actual coefficients to the desired values will 
simultaneously minimi ze. the J of equation (21) for any set of initial 
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conditions . 



The measures indicated above are carried out by first taking the 



gradient of J with respect to and a^. 



3J 



^^11 . ^^12 2,«v ^^22 



Stj = *2<°) 3^7 * *2<“) 57-= ° 



^Pll ^ Ri o o ^^99 

^+2»^(0> X^(0>5J^*X^(0)5^= 0 



( 22 ) 



The initial conditions will be assumed to be generally non-zero and 
completely independent. The only possible solution to equations (22) 
must then be of the form 




.n 



(23) 



Substitution of equations (20) into equations (23) yields 



X = 




(24) 



and 




(25) 



Similar developments have been carried out for the third and 
fourth-order systems, some details of which are included in the ap- 
pendix. At this point, a recursion formula for the structure of 
the a's in an nf^ order model was postulated on the basis of second, 
third, and fourth-order model calculations. From this recursion 
formula, equation (26), a prediction was made for the fifth-order 
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case, and was proved correct by extremely lengthy but straightforward 
algebra. This successful prediction of the ^ifth-order a*s has been 
accepted as sufficient proof of the validity of the recursion formula. 



OL 



and 



i,n ~ 2 






n-l 






i+k 



ks=l 



(26) 



where n is the order of the model, and 1 S i s n. By definition, 



a =0 
o 



a 1 = 1 
i>fl 



(27) 



^(nfl+i) 



0 ; je > 0 
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CHAPTER III 



ILLUSTRATIVE EXAMPLES 



EXAMPLE I 



Consider the second-order feedback control system of Figure 2. 

The amplifier gain k is the only variable parameter, and is to be 
selected so that the system’s transient response to a given disturbance 
is a best approximation to the model, or desired response. The model 
response has been chosen by the designer as the response characterized 




Fig, 2 Feedback control system of Example I 

by closed-loop roots of damping ratio ^ = 0,7 and natural frequency 

CO =2,0 radians per second. An inspection of the system root locus 
n 

for 0 :£ k ^ 00 makes it immediately apparent that the ideal root lo- 
cation is unattainable. One may therefore turn to minimization of a 
performance index, as suggested in the previous pages, as a means of 
selecting k. 

The system of Figure 2 is for present purposes best represented 
by the state variable signal-flow graph of Figure 3(a). The model 
system of Figure 3(b) reflects the desired but unattainable char- 
acteristic equation coefficients for the specified root locations. 
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1 

^2 s 



1 





Fig. 3 Slgnal>£low graphs. Example I. 

(a) actual, (b) model. 

From characteristic equation s^ + 328 + a^^ = 0 



For convenience, let the system be disturbed by the initial conditions 
Xj^(O) = 1,0, X2(0) = 0, and r(t) = 0. The cost function of equation 
(21) then reduces to 

J = x^(0) pj^ = p^^ (28) 



where Pj^j^ is given, for this second-order system, by equation (19). 
The Q matrix is now to be evaluated. Substituting the model coef- 
ficients, and ^2 ~ into equations (24) and (25) gives 



«2 = - 0-01 



and 



(29) 



X = 



16 



These values are then substituted in equation (18), yielding 



Q = 



(- 1 ^) 



16 



k 

TE 



(- 0.01 + ^) 



(30) 



where aj^ = k and ^ 2 ~ actual system coefficients. It is 
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to be noted that the model coefficients appear in Q.only through the 

quantities ot and X* Whenever else in the Q matrix the a *s appear, 
^ n 

they are the actual system coefficients, either fixed and known, or 
functions of the parameters that are to be determined as optimum. 
Equations (19), (28), and (30) combine to give 

11 

J= -0.005k X ^ ^ + i (31) 



Minimizing J with respect to k gives 



-0.005 - = 0 

ak 



(32) 



Equation (32) has the real solution 



k = 2.03 



(33) 



Figure 4 shows the system root locus and compares the model and 

jto 

actual root locations « 



Model ^ 

CO = 2.0 
n 

C = 0.7 



-X- 



Fig* 4 Root locations for Example I 



Optimum 

CO = 1.425 
n 

C = 0.35 



Figure 5 compares the model and actual transient responses, as 
simulated on the analog computer. 
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Fig. 3 Transient responses, Example I 



Further insight into the method and means by which the optimum 
value of k was found may be obtained by investigation of the cost 
function associated with two free coefficients in Example I. If both 
coefficients in the characteristic equation are allowed to be free, 
the Q matrix becomes, for the same model values of ^ 



^2 “ 2 * 8 , 






V2 

16 



16 



(- 0 . 01 *^) 



(34) 



The cost function from equations (19), (28), and (34) Is now 

2 

0.005 ^*3^ +3^ (35) 



Figure 6 Is a plot of the surface generated by equation (35). This 
surface Is, for the Initial conditions of the example, uniquely asso- 
ciated with the values of the model coefficients, a^^ = 4.0 and 
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а. = 2.8, and displays its minimum J , .at these very values. 

This is a consequence of the way in which the Q matrix was constructed, ^ 
and of the manner in which the weighting factors were derived; com- 
plete freedom to vary all coefficients will always yield the model sys- 
tem. In the case of Example I, where a constraint is placed on one 
of the two coefficients in the form of - 1.0, it is not possible to 
drive to the absolute minimum on the cost surface. The constraint is 
equivalent to passing the plane a^ = 1.0 through the cost surface. 

The optimum value of a^^ = k is then that value which achieves a min- 
imum J . on the intersection of the plane and surface. From Figure 
min 

б, it is seen that this value is k = 2.03, in agreement with equation 
(33). 
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Fig. 6 Isometric pro- 
jection of the cost 
surface in Example I, 
as a function of the 
two variables a^ and 

a^, for a model sys- 
tem characterized by 
^ * 0.7 and co^ = 2.0 
4.0, a^ 3 2.8) 




0 I 2 
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EXAMPLE II 



The third-order feedback control system of Figure 7 is to be 
compensated using rate feedback as shown. The gains h and k are 




Fig. 7 Feedback control system of Example II 



to be. selected so that the system is optimum with respect to a model 
having a complex conjugate root pair with 00 ^^ 2.0 radians per sec- 
ond and ^ = 0.7, and the third root at s = -5.0. Inspection shows 
that the model poles have been placed in a region of the s plane made 
unattainable by the constraints of the compensation scheme chosen. 

The model root locations correspond to the characteristic equation 

+ 7.8s^ + 18s 4 - 20 = 0 (36) 

The actual system is characterized by the equation 

+ 2s^ + (h + l)s + k = 0 (37) 

Equation (37) shows that a^ in the actual system is constrained to 
the value 2.0, and that there exists complete freedom to vary the 
a^^ and a^ coefficients. 
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To show the single cost surface associated with three degrees 
of coefficient freedom is, of course, graphically impossible. The 
constraint = 2,0, however, is effectively a plane which intersects 
the hypersurface in such a way as to yield a subsurface dependent 
upon and a^ alone, and hence graphically representable. Equi- 
valently, a family of surfaces giving J as a function of a^ and a^ 
with a^ the family parameter could be drawn. The surface corres- 
ponding to a^ = 7.8 would display the absolute minimum of all sur- 
faces, while the surface drawn for = 2.0 would display a minimum 
greater than the absolute minimum, and would yield the optimum values 
of a^^ and a^ and hence of h and k. Figure 8 is a plot of the sub- 
surface for a^ = 2.0, the equation for which is derived below. 

From the recursion formula (26), for the third-order model 
with a^ = 7,8, = 18,0, and a^ = 20.0, 

_ 12 

“2 " 2 “ 400 

2 

^3 '^^2 _ 24.8 (38) 

0 : 3 “ 2 ~ 400 

^1 
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360C • 



3200- 



2800* 



2400 * 



2000 



1800 > 



1200 



800* 



400 - 



Fig. 8 Isometric pro- 
jection of the coat sub- 
surface in Example II, 
as a function of the two 
variables a^^ and a^> 

a model system character- 
ized by a^ 3 20.0, 

a^ = 18.0, and a^ = 7.8, 

and where the actual sys- 
tem is constrained by 
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? 








From equation (18), the Q matrix is 



* 400 ^ 



^ 1^2 

400 



!!i 

400 



Q = 



^ 1^2 

400 



12 2 
^400 400 



400 



400 



!!2 

400 



. 24.8 4 

^ 400 400^ 



(39) 



Again for convenience, the system will be disturbed by an initial 
unit displacement only, in which case 



'11 



11 “Pll 




(40) 


for the third- 


■order system is given by 


2 

r^2 ^3 




r ®i^3 


[2aj^ 2(a233 


-a^) J "^12 ^22 


L2(a2a3 -a^) 




2 




r- 1 . 


q 1 


(41) 




^33 L2(a a -a ) J 



24 







► # 







i 








I 

I 

I 

I 

i 

I 

I 

I 



From equations (39), (40), and (41), with a^ = 2.0, 

800 a^ -400 aj^a^ + a^a^ + 24a^ + 

_^4.8 aj + 1600 a. 

j = i i =i 

2a (2a -a ) 



( 42 ) 



By far the most reasonable method of finding a^^ and a^ for 
J^in in equation (42) is by surface search techniques using a gen- 
eral-purpose digital computer. In this case the search was con- 
ducted by incrementing the parameters a^ and a^ about an initial 
point, testing for the maximum decrement in J, establishing a new 
initial point, and repeating the process until the minimum was lo- 
cated. J was found to lie at 
min 



a 



1 “ 



6.3 



®2 



7.9 



giving optimum gain settings, by equation (37), of 



(43) 



k = 6.3 
h = 6.9 



(44) 



Figure 9 compares 
Figure 10 compares the 



the model and actual root locations, while 
transient responses. 
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A 



□ 

A Model: S = -5, -1.4 ± jl.43 

Q Optimum: S = -0.91, -0.54 ± J2.56 

Fig. 9 Root locations for Example II 



^ Model 




Fig. 10 Transient responses for Example II 
It is of interest to note that the dominant mode method dis- 
cussed in Chapter I, if applied to Example II, yields a peculiar re- 
sult. Since two coefficients are independently free, it is reason- 
able to expect that a pair of complex conjugate roots may be exactly 
placed. No control is possible over the position of the third, real 
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root, p. If the conjugate pair is placed at r = 0.7, to = 2.0, 

n 

(s^ + 2.8s + 4)(s + p) = 0 (45) 

which upon multiplication becomes 

s^ + s^(2.8 4. p) 4. s(2.8p + 4) 4- 4p * 0 (46) 

Equation (46) is to be compared, with respect to coefficients of like 
powers of s, to the actual system equation 
3 2 

s 4. 2s 4- (h 4- l)s 4- k ss 0 (47) 

such a comparison shows 

p =: -0.8 

k = -3.2 (48) 

h= 0.76 

The resulting system is obviously unstable. 

EXAMPLE III 

A feedback control system with a zero in its closed-loop transfer 
function does not fit the classification established by Figure 1. It 
will now be shown, however, that zeros may be accounted for by intro- 
duction of forward, non-looping paths from appropriate state vari- 
ables in the signal-flow graph of Figure 1 , and that the method of 
optimization employed in the previous examples may again be used with- 
out modification. 

The closed-loop transfer function of the system in Figure 11 may 
be written 
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k 



• (8 + z) (49) 




”3 2 

s + s (p + 1) + s(p + k) + kz 
which displays a closed-loop zero at s = -z. The signal-flow graph 



c 


k (s + z) 




1 


i 


i 


(s + p) 




s(s + 1) 



Fig. 11 Feedback control system of Example III 
of equation (49) is shown in Figure 12. One notes that all the closed- 




loop pole information is contained within the dotted line enclosing 
the feedback portions of the graph, and that this part of the graph 
is consistent with the form of Figure 1. From equation (49), 
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c = (s + z)x^ (50) 

Equation (50) describes the feed-forward paths necessary to make up 
the output, c, and also accounts for the closed-loop zero. 

The design objectives of this example may be stated by selecting 
model values £br the three poles and one zero. The values of k, z, 
and p are then to be selected so that the resulting system is optimum 
with respect to this model. It should be noted that at first inspection, 
three parameters are independently variable, and that one could con- 
ceivable place the three closed-loop poles precisely where they were 
wanted and let the zero fall where it may. This, however, is not in 
keeping with the idea of driving a constrained actual system as close 
as possible toward a model whose respective pole and zero locations 
are considered ideal, and which has the same number of poles and zeros 
as the actual system. 

The model poles are specified as a pair with (jO^- 2.0, ^ = 0.7, 
and a real pole at s = -5.0. The model zero will be placed at s = -2.0. 
One now observes that the zero of the actual system may be made to 
coincide exactly with the model zero simply by setting z - 2.0. This 
is an arbitrary choice but a necessary one, since the present method 
optimizes a response on the basis of pole location alone. There re- 
mains, then, the task of placing the three system poles so as to be 
optimum with respect to the model poles, using the two free parameters 
k and p. Because the zero has been dealt with and disposed of , only 
that part of Figure 12 lying within the dotted line is yet to be 
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determined. It is for this configuration that the optimization meth- 
od of Chapters I and II has been derived. 

With z s 2.0, the closed- loop transfer function becomes 

£_ ^ (51) 

^ s^ + s^(p + 1 ) + s(p + k) + 2 k 

Because the model pole locations of this example are identical to those 
of Example II, 0 ( 2 * 0^3 > X «re given by equations (38). Following 
the same steps as those taken between equations (39) and (42) of Ex- 
ample II, one finds 



400p^ + leookp^ + 448k^p + 400p^ + 1600k; 
_-352k^ 4. 8 k^p 4 - 230. 4k^ + 800k 8 k^ 

1600k(p^ kp 4 - p-k) 



(52) 



Minimization of (52) with respect to k and p was carried out by surface 
search techniques and yielded the values 



k = 10.8 

p = 8.0 



(53) 



The cost J could have been expressed in terms of the a^ coeffi- 
cients rather than k and p, in which case 
= 2 k 

a^= p + k (54) 

- a -^/2 + 1 

The minimization would then have been carried out with respect to a^ 
and 82 rather than k and p. Algebraic solution for k and p would then 
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follow by equations (54). 



Figure 13 compares model and actual pole and zero locations. 




□ Actual; s = -6.6, -l.16ijl.37 
O Zero identical for model and 
actual systems, by choice. 

Fig* 13 Pole and zero locations for Example III 



^ Actual 




Fig. 14 Transient responses for Example III 
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It must be emphasized that the solution obtained above is not un- 
ique, since a different set of optimum parameters would have emerged 
had another value been selected in the free choice of the zero loca- 
tion. Furthermore, many such solutions would very likely show that 
among those many optimum systems there is one that is '’most optimum” 
in terms of cost, J. Indeed, this solution would be the one first men- 
tioned in this example, in which the three poles assume their model 

values, giving the absolute minimum cost, J . . . Doubts might be 

min mm 

cast on the acceptability of Such an “optimum optimum”, however, if 
the zero turned out to be far removed from the model zero, for the 
cost function J does not penalize the output of the system of Figure 
12, and acknowledges the presence of the zero only insofar as it affects 
the closed-loop poles. For this reason, it is suggested that whenever 
free zeros are introduced, as for example by cascade compensation, 
these zeros be placed at or near the model zero values for a first 
solution. The results of Example III indicate that this approach can 
yield very satisfactory results. 
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CHAPTER IV 



DISCUSSION AND CONCLUSION 

A- STABILITY 

The question of stability must be discussed in connection with 
any method of control system design. The method of the previous chap- 
ters will consistently yield a stable optimized system if a few 
straightforward guide-lines are followed in setting up any particular 
design problem. 

The first requirement is that the model system be stable. This 
insures that there will exist a multi-dimensional cost surface, posi- 
tive in a region surrounding the model parameter values, and exhibiting 
a minimum at these model values. The region of stability for the model 
cost surface has bounds determined only by the order of the system. 

The stable region for the surface of Figure 6, for example, is defined 
by >0, ^2 ^ total surface of Example II, of which 

Figure 8 is a subsurface, the stability region would be defined by 
^2^3 " ^ ^ ^2 ^ ^3 ^ ^ fact which is made evident 

both by the Routh criterion and by equation (41). 

The designer will normally choose a compensation scheme that 
provides a good measure of feedback from plant variables, simply be- 
cause these variables contain information about the more basic but un- 
available state variables. He may also choose to approximate the 
state variables by the use of various filter networks. In any event, 
it is more likely that the final choice of compensation will at least 
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allow absolute stability. Any concern with stability is now ended, 
for the optimization process that follows stabilization cannot possibly 
render the system unstable. The fact that the system can be stable 
indicates that the real system’s constraints on the coefficients of 
the characteristic equation are such that the cost subsurface gen- 
erated by the constraints lies within the stable region of the model 
surface, and exhibits its minimum therein. Figure 8 shows just such 
a subsurface generated by a constraint = 2.0 in Example II. It 
should be noted that there is now a secondary stability region ack- 
nowledging the constraint, and defined by 2a^ - a^ > 0, > 0> ^2 ^ 

In searching the subsurface for its minimum and hence the optimum 
values for and a 2 > care must be taken that the search begin at a 
point known to be within the stable region. 

In summary, stability is handled by any of the conventional methods. 
By applying them, the designer insures that the compensated system can 
be stable. The stability region for the constrained surface (sub- 
surface) is determined, and the search of the subsurface proceeds from 
a point known to be in the stable region. 

B. COST SURFACE SELECTIVITY 

SENSITIVITY TO PLANT PARAMETER VARIATIONS 

The term selectivity will be associated with the slope of the 
cost subsurface in the neighborhood of its minimum, or optimum point. 

High selectivity will indicate a relatively sharp minimum; low selecti- 
vity, a shallow minimum. Low selectivity in a cost function can be 
somewhat undesirable in certain contexts. Let it be assumed, for 
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example, that a system is being adaptively optimized with respect to 
a certain integral index of performance, and that the index, or cost, 
is being evaluated by actual integration of the appropriate functions 
of the system’s state variables as they respond to a perturbation. 

It is further assumed that the state variables called for in the in- 
dex are available and measurable. As soon as measurement enters the 
problem, measurement errors inevitably follow. It is easily seen that 
small errors in cost evaluation can bring about relatively large errors 
in the optimum parameter settings for the case in which the cost sub- 
surface near the true minimum is inherently shallow. 

The design method of this paper, however, does not in any way 
rely upon the measurement of dynamic variables, and is to that extent 
free of low selectivity shortcomings. Given that a cost subsurface 
has a true minimum, that minimum can be located with as much accuracy 
as computing machines will allow, be the minimum shallow or sharp. 

Measurement errors of another kind do find their way into the 
present method via the identification of the plant’s configuration 
and fixed parameters. The term sensitivity shall be employed to 
describe the relationship between a small change or error in a 
given fixed plant parameter and the corresponding displacement of 
the cost subsurface and its true minimum. A high sensitivity would 
indicate that relatively greater care would need be taken in de- 
termining the fixed constants of the plant being controlled. 

Sensitivity may be dealt with quantitatively, as will now be 
shown using Example I for illustration. Let the open- loop plant 
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pole in Figure 2 of Example I take on all values on the negative real 
axis; i,e», if the pole factor is designated as (s -f p), 

0 < p < 00 (55) 



Assume that the optimum value of k has been determined for enough 
values of p to establish the hypothetical curve of Figure 15. The 




gain k as a function of plant pole p for 
the system of Figure 2 



sensitivity of the optimized parameter k to changes in the plant pole 
p is defined as 



s - ^ 

°kp dp 



(56) 



of simply the slope of the k versus p curve. 

The cost function of equation (31) may be rewritten to include 
the plant pole literally, as follows: 



j = 0.005 

Optimization is carried out with respect to k, giving 



(57) 



5 J _ 0.005 _ p k 

(^k “ " p ' 2k^ 



( 58 ) 
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Equation (58) may be solved to give the optimum k for any plant pole 
p, for the model system selected in Example I, = 2.0, ^ = 0.7. It 
may also be differentiated with respect to p to yield the sensitivity 
of the optimum gain to changes in the plant pole p. From equation 
(58), 



-0.08k^ - 8p^ + = 0 

and 



(59) 



-0.16k ~ -16p + 3k^ = 0 

dp dp 

from which 



(60) 



^ _ 16p 

3k^ -0.16k 



(61) 



Substituting the values p = 1.0 and k = 2.03 from Example I, gives 



S 



kp dp 



1.33 



(62) 



Thus there has been added to the coordinates of a single point on the 
curve of Figure 15 the slope at which the curve passes through that 
point. Although no further information about the curve has been de- 
duced, this figure for sensitivity gives assurance that small changes 
in the plant pole about the value p= 1.0 would not call for drastic 
changes in the optimum forward gain setting, and that no violent de- 
parture from optimum response will be observed if the gain setting is 
left at a single constant value. 

It is believed that the sensitivity problem as described above 
presents a potentially fruitful area for further investigation. 
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C- POTENTIAL APPLICATION IN ADAPTIVE SYSTEMS 



The examples in Chapter III deal with linear, t ime» invar iant 
plants and the selection of compensator parameters to optimize per- 
formance relative to a model. The design is carried out but once, 
and remains valid as long as the plant remains unchanged. Should 
the plant constants change for any reason, the design becomes invalid 
in the strict sense of optimality with respect to the model. The ex- 
tent to which plant parameter variations may be troublesome is in 
part a function of the sensitivity associated with each parameter. 

The effect of the variations can be counteracted by effectively re- 
designing the system constantly, or as often as new information about 
the changing plant parameter is made available. Thus the system 
would be adapting to changing conditions by continuous optimization. 

Figure 16 shows a suggested functional block diagram of such an 



Input 




Fig. 16 An adaptive system using a digital computer 
for surface search and optimization. 
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adaptive system. It is assumed that a satisfactory scheme of plant 
parameter identification is available. Information from the identifier 
is sent to a special purpose digital computer, into which has been 
programmed all the information necessary for the continual construction^ 
search, and minimization of the cost subsurface appropriate to the 
plant, the compensator configuration, and to the model system. Optimum 
control parameter settings are then continually updated as the identi- 
fier and digital computer monitor the operation of the system. 

Some further dividends are potentially available in the adaptive 
system outlined above. Many identification schemes require as much 
information as possible about the system's state variables; i.e., the 
system output and its successive derivatives. These variables are not 
often available, especially in higher-order systems. Identification 
then requires that some knowledge of some, if not all, of the state 
variables be gained by approximation techniques. As long as some of 
the higher derivatives are being approximated for use in identification, 
they might just as well simultaneously be used as feedback signals, en- 
abling greater conformation of the actual system dynamics to those of 
the model. In the very unlikely case that all the state variables 
could be accurately approximated, the design procedure of this paper 
is not needed, nor for that matter is any other, since complete free- 
dom would then exist for the placement of all system poles. 

D. THE OPTIMUM SYSTEM AS A FUNCTION OF INITIAL CONDITIONS 

The illustrative examples of Chapter III are all based upon an 
initial condition of displacement (x^(0) 7 ^ 0) only. This type of 
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disturbance was chosen because of its equivalence to a step input for 
a system with unity feedback in the outermost loopo This conforms to 
the wide use of the step as a test input in control system design. 

It should be noted that the admission of non-zero values for the 
higher-order initial states will, for constrained systems, give rise 
to optimum free parameters that yary as functions of the direction of 
the initial condition vector in the initial condition vector space. 
This may be illustrated by referring to the cost associated with a 
second-order system, as a function of the initial conditions and the 
elements of the P matrix. This was given in equation (21) as 



J = x^(0) + 2x^(0) X2<0) + ^2^0) 



(63) 



It is obvious from equation (63) that at least the shape of the total 
cost surface is a function of the initial conditions, and that the 
subsurfaces and their associated local minima generated by the actual 
system constraints will move about with changing initial conditions. 

It must be observed, however, that the minimum of the total cost sur- 
face is unalterably and securely tied to those coordinates specified 
by the coefficients of the model system. Equations (22) and (23) 
guarantee that the share a common minimum independent of the 

initial conditions, and similarly guarantee that any linear combination 
of the such as equation (63), also displays that same minimum. 

A completely free system, then, will always optimize at the model 
values. A system so constrained that the model poles are unattain- 
able but relatively close to the attainable region will yield a 
narrow range of optimum solutions as initial conditions are changed. 
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It is not necessary to exhaust all points in the initial condition 
space to observe the migration of the optimum poles as a function of the 
initial conditions. Figure 17 shows the initial condition space for a 
second-order system. Point "1" is located on a unit circle centered 
at the origin. Point "2" shares a radial line with "1", and lies at a 

Xj^(O) 

Fig* 17 Initial condition space, second-order system 

radial distance d from the origin. It can be shown by simple sub- 
stitution in equation (63) that the costs associated with points 

2 

••1** and ”2** differ only by the constant (d ). This means that only 
the unit circle in the Xj^(O), ^ 2 ^®^ plane need be investigated. 

Points on this unit circle may be “mapped” onto the s-plane by de- 
termining the optimum pole locations for the constrained system cor- 
responding to all points on that circle. The result will be a locus 
or region of optimum root locations for all possible initial condi- 
tions. The size and extent of the region, it is felt, will in large 
measure be dependent upon the proximity of the model poles to phy- 
sically realizable pole locations. Such a region is shown in Figure 
18, drawn for Example I. The end points of the optimum locus are 
not determined. 
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^ Model poles 

--- Physically realizable 
root locus 

Boxes enclose optimum 
portions of the locus 

Fig. 18 Model poles and optimum pole 
locus for the conditions of Example I 

It is felt that further investigation of these optimum regions pre- 
sents a possible avenue for future research# 



42 



APPENDIX 



I Solution for the P matrix from equation (13) 
1) Second-order system 
From equation (13), ^ 



- 








— — 








— _ 


"‘^11 "'‘12 




**11 **12 




0 1 




0 - aj ^ 




^11 **12 


"‘^21 "^22 




?21 ^22 




■®1 "®2 




1 -^2 




P21 P22 


“““ " 




— » 




— — 









^ ( Al )"^ 



where P and Q are symmetric matrices. Matrix multiplication yields 
-qil = -2a^p^2 
■*^12 “ *^11 "® 2*^12 "^ 1^22 
- q 22 = 2 p ^2 " 2 ® 2*’22 

Equations (A2) may be graphed as shown in Figure Al. 




Fig. Al Signal-flow graph for equations (A2) 

The elements of the P matrix may be written directly from the graph, 
using Mason's gain formula. 
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0 



Pll = 



■‘’12 2 a, ^11 + 2 a ^ 



2 11 2 a 2 '*22 



Pi 9 = 



‘11 



12 “ 2 a, 



(A3) 



P99 ~ 



‘22 



*11 



22 " 2 a, 



^® 1^2 



2) Third-order system 
From equation (13), 



-^11 


■‘>12 


■‘>13 




Pll 


P 12 


Pl3 


■^21 


■‘>22 


■‘>23 


= 


P 2 I 


P 22 


?23 


■‘>31 


■‘>32 


■‘>33 




P 3 I 


P 32 


P 33 




0 0 -a. 



1 0 -a. 



0 1 -a. 



Pll ^12 *^13 



P21 P22 P23 



P3I **32 P33 



(A4) 

The nine scalar equations resulting from matrix multiplication In equ* 
atlon (A4) may be reduced to six by S 3 rmmetry. They are 



•’ll = ■ 2 ’ i '’ i 3 



‘>12 = 


Pll 


■®2Pl3 ■®lP23 


‘>13 = 


P 12 


■®3Pl3 ■®lP33 


‘>22 = 


2Pi2 


■2a2P33 


‘>23 = 


P 22 


■®3P23 Pl3 


‘>33 = 


^P23 


■^®3P33 



(A5) 



These equations are graphed in Figure A2. 
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Fig. A2 Signal-flow graph for equations (A5) 
Application of Mason's gain formula yields 



Pl3* 

Pll« 
P 23 - 

P 12 
P 33 “ 

P 22 “ 



qil/2ai 

f3 ^22^1^3 ^13^1^3 

^11 K2a^ 2D J ”'^12 2D " D 

^11^3^ ^22^3 ^13^3 ^33^1 

2aj^D 2D ’ D 2D 

^ 13 ^ 2^3 ^ 33 ^ 1^2 ^ 11 ^ 2^3 ^ 22^1 

D ■*■ 2D 2aj^D 2D 

^11^3 2i2 _ ^ "^33^2 

2aj^D ■*■ 2D ' D 2D 



^33^1 

2D 



2 



(A6) 



r ^2^3 ^3 1 ^33^^2 ^1^3^ 

■‘^23 '^ll V 2a^D “ 2a^ 7 ■*■ 2D 

''l3^^2 ■*■ ®3^ ^22^^2 ■*■ ^3^ 

D 2D 



D 



" ®2^3 



a 



1 
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3) Fourth-order system 

Manipulation of equation (13) for the fourth-order system yields ten 
equations, whose graph is shown in Figure A3. The elements of the 
P matrix may again be written directly, using Mason's gain formula. 
Only Pj^j^ is given here because of space limitations. 

r ®3®4 "*2®3 "®1®4 ^ ^13^®1®2 "®1®3®4^ 

hi “ '^11 V 2a^ 2D y "^12 ”*■ D 



+ 



+ 



*'22<n‘'3°4 

2D D 2D 

^44®1®2 

2D 



(A7) 



D = «2®3®4 “®1®4 ■ ®2 

4) Fifth-order system 

From equation (13), using signal-flow graphing, (not shown) 
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Fig. A3 Signal- flow graph for the Q 
equations of the fourth-order system 
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(A8) 



3 2 

a, -a,a„a. 



)* ’isC 



a, a, a, -a, a. 



-1 “ 1 “ 2“5 ^ ^ “ 1 “ 4“5 “13 

+^35 C. ^ 



2 3 
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II Derivation of the g's and X 



1) Second- order system 



From 






= 0; i, j = 1 - 2 



(A9) 



and Q as given in equation (18), six equations are obtained, only 
two of which are independent or non-trivial. They are 



and 







^1^2 



(AlO) 
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from which 



ar 



4 -^‘1 



Si. 



(All) 



2) Third-order system 

From 

aPii 

» 0 ; 1 £ n s 3 (A12) 

i, j as in equations (A6) 

and Q as given in equation (18), eighteen equations are obtained, only 
three of which are independent or non-trivial. They are 

X = -7 
a 

1 



®1^2.“3 "^2^3 + «i «2 + ^2 2®1^ = ° 



®1 “3 + ^ ^® 1^2 «2 A ^3 = ° 



(A13) 



The last two of equations (Al3) may be solved for the a*s to give 



0!2 = 



al -2a^a3 



®1 

a] -2a2 



(A14) 



«3 “ 2 

a. 



3) Fourth-prder system 

Similar procedures applied to the fourth-order system yield four in- 
dependent equations, whose solutions are 
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a “ 






(A15) 



a-: 



“2a2a^ + 2a^ 



CK 



" 2^3 



4 2 

^1 



4) Fifth-order system 

The fifth-order system yields the following solutions; 
1 

X “ 0 






"2 “ 2^133 



2 2 



®3 "^^ 2 ^ + 2 ® 1®5 

«3- 2 



(A16) 



“4= 



^ -2a3V^ 



4 

2 
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